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Some Properties of Reflected Backward 
Stochastic Differential Equations for a Finite 
State Markov Chain Model 

Zhe Yang * Dimbinirina Ramarimbahoaka* 
Robert J. Elliott 


Abstract 


In this paper, we provide an estimate for the solutions of re¬ 
flected backward stochastic differential equations (RBSDEs) driven by 
a Markov chain, derive a continuous dependence property for their so¬ 
lutions with respect to the parameters of the equations, and show sim¬ 
ilar properties for solutions of backward stochastic differential equa¬ 
tions (BSDEs). We finally establish a comparison result for the solu¬ 
tions of RBSDEs driven by a Markov chain. 

Keywords: Markov chains; RBSDEs for the Markov Chain; comparison 
theorem. 

1 Introduction 

In 2012, van der Hoek and Elliott |B] introdnced a market model where 
nncertainties are modeled by a hnite state Markov chain, instead of Brownian 
motion or related jnmp diffnsions, which are often nsed when pricing hnancial 
derivatives. The Markov chain has a semimartingale representation involving 
a vector martingale M = {Mt G , t > 0}. BSDEs in this framework were 
introdnced by Cohen and Elliott |2] as 
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where F is the driver, ^ is the terminal condition and M is a vector martin¬ 
gale given by the dynamics of the Markov chain. 

Cohen and Elliott [3] and [1] gave some comparison results for multidi¬ 
mensional BSDEs in the Markov Chain model under conditions involving not 
only the two drivers but also the two solutions. Cohen and Elliott |1] also 
showed the existence of solutions of the above equations with stopping times 
and introduced a type of nonlinear expectations called F-expectations, cor¬ 
responding to the solution of these equations and based on the comparison 
results. Yang, Ramarimbahoaka and Elliott [10] extended the comparison 
result for two one-dimensional BSDEs driven by a Markov chain to a situ¬ 
ation involving conditions only on the two drivers and provided a converse 
comparison result in terms of F-expectations defined in Hi. 

An, Cohen and Ji [T] discuss American options using the theory of re¬ 
flected backward stochastic differential equations (RBSDEs) with Markov 
chain noise in discrete time. Based on the comparison theorem in [TOl and 
using the penalization method Ramarimbahoaka, Yang and Elliott [7] estab¬ 
lish the existence and uniqueness of the solution (R, Z, K) of the following 
RBSDE: 

i) = e + /f+ J^ZidM,, 0<t<T- 

ii) Vt > Gt, 0 < f < T; 

iii) {Kt,t G [0,T]} is continuous and increasing, moreover, Kq = 0 and 

J^iVs-Gs)dKs = 0. 

This is proven under some conditions on the terminal condition the driver 
/ and G, which is called an obstacle, and is a process to force the solution 
V to stay above G. 

In this paper, we derive some properties of RBSDEs for the Markov chain 
noise case. We provide an estimate for the solutions of this type of equa¬ 
tion which establishes their boundness in some sence. We then discuss the 
difference between two solutions depending on the parameters of two equa¬ 
tions, and deduce similar properties for solutions of BSDEs with Markov 
chain noise. We hnally show comparison results for the solutions of RBSDEs 
driven by a Markov chain martingale. 

The sections of the paper are as follows: In Section 2, we present the 
Markov chain model and some preliminary results. Section 3 establishes an 
estimate of the solutions of RBSDEs for the Markov Chain, and Section 4 
discusses the continuous dependence property of solutions of RBSDEs for 
the Markov chain. In the final section, we deduce a comparison result for 
one-dimensional RBSDEs driven by the Markov chain. 
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2 The Model and Some Preliminary Results 

2.1 The Markov Chain 

Consider a finite state Markov chain. Following [ 8 ] and [9] of van der 
Hoek and Elliott, we assume the hnite state Markov chain X = {Xt,t > 0} 
is dehned on the probability space P) and the state space of X is 

identihed with the set of unit column vectors {ci, 62 • • • , cat} in where 
e, = ( 0 , • • • , 1 • • • , 0 )' with 1 in the Fth position.Take Xt = (^{Xg] 0 < s < t} 
to be the a-algebra generated by the Markov process X = {Xt} and {Xt} to 
be its completed natural hltration. Since X is a right continuous with left 
limits (written RCLL) jump-process, then the hltration {Xt\ is also right- 
continuous. The Markov chain has the semimartingale representation: 



( 1 ) 


Here, A = {AtA > 0} is the rate matrix of the chain X and M is a vector 
martingale (See Elliott, Aggoun and Moore [ 6 ]). We assume the elements 
Aijit) of A = {AtA > 0} are bounded. Then the martingale M is square 
integrable. 

For our Markov chain Xt G {ci, • • • , Cat}, note that XtX[ is the matrix 
diag(Xt). Also, from ([T]) dXt = AtXtdt + dMt. Then, by the product rule 
for semimartingales, we obtain for any t G [0, T], 



0<s<t 



( 2 ) 


Recall, {X, X) is the unique predictable process such that [A, X] — {X, X) 
is a martingale and write L for the matrix martingale process 


Lt = [X,X]t-{X,X),, tG[0,T]. 
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However, we also have: 


= diag(Xt) = diag(Xo) + / diag(H 5 Xs)(is + / diag(M 5 ). (3) 


Equating the predictable terms in ([2]) and ([3]), we have 

{X,X)^= [ diag{AsXs)ds - [ diag(XjH'(is - [ H^diag(Xs)(is. (4) 


Let 'h be the matrix 

'Li = diag(HiXi_) - diag(Xi_)H' - Hidiag(Xi_). 


(5) 


Then d{X,X)t = dltdt. For any t > 0, Cohen and Elliott [2],|3], dehne the 
semi-norm ||.||xt) for C,D E as: 

{C,D)^^=Tr{C'%D), 

niw* = (C’,C'U- 

We only consider the case where C G R^, hence we introduce the semi-norm 
ll-lUt as: 

{C,D)^^=C'%D, 

\\C\\% = {C,C)^^. 

It follows from equation (jT]) that 

r\\C\\lds= f C'd{X,X)^C. 

Jt Jt 

Lemma [2.II is Lemma 3.1 in Cohen and Elliott [1]. 

Lemma 2.1. For Z, a predictable process in , verifying: 


E 




uo 


< CXO, 


we have: 



’/ /•* 


A 

E 

/ Z'JM^ 

= E 

/ \\Zu\\\ju 


\Jo J 


Jo 
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Definition 2.2 (Moore-Penrose pseudoinverse). The Moore-Penrose pseu¬ 
doinverse of a square matrix Q is the matrix satisfying the properties: 

1) QQ^Q = Q 

2 ) Qtggt = gt 

3) {QQ^y = QQ^ 

4) WO)' = 0*0. 

Denote by V, the cr-field generated by the predictable processes defined 
on and with respect to the filtration {J^i}te[o,oo)- For t G [0,cxo), 

consider the following spaces: 

L‘^{iFt) '■= {C; 'C is a M-valued J^t-measurable random variable such that 
£[|JP1<(X.}; 

:= {0 : [0, t] x D —)■ M; cp is an adapted and ROLL process with 

F;[/o |0(s)|2ds] < +CX)}; 

:= {(j) : [0,t] x D —)■ 0 is a predictable process with 

< +oo}. 


2.2 BSDEs for the Markov Chain Model. 

Consider a one-dimensional BSDE with the Markov chain noise as follows: 

f{u,Yu,Zu)du-Z'^dMu, te[0,T]. (6) 

Here the terminal condition ^ and the coefficient / are known. 

Lemma 12.31 (Theorem 6.2 in Cohen and Elliott [2]) gives the existence 
and uniqueness result of solutions to the BSDEs driven by Markov chains. 

Lemma 2.3. Assume ^ G o,nd the predictable function / : Dx [0, T] x 

R X R^ —)■ R satisfies a Lipschitz condition, in the sense that there exists two 
constants li,l 2 > 0 such that for each yi,y 2 eM and zi, Z 2 G R^, t G [0, T], 

I/(Ci/i,d) - f{t,y2,z2)\ < h\yi - y2\ + hWzi - Z2\\xf ( 7 ) 

We also assume f satisfies E[Jq \p{t,0,0)\dt] < oo. 

Then there exists a solution (Y, Z) G Lj'(0)F;R) x Pj-(0,T;R'^) to BSDE 
m- Moreover, this solution is unique up to indistinguishability for Y and 
equality d{X,X)t xP-a.s. forZ. 


Yt = ^ + 
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Assumption 2.4. Assume the Lipschitz constant I 2 of the driver f given in 
()7]) satisfies 

^ 2 ||^l||ivxjv\/^ < 1, for any t e [0,T], 

where 4^ is given in (jS]) and m > 0 is the hound of\\At\\NxN, for any t G [0, T], 

The following lemma, which is a comparison result for BSDEs driven by 
a Markov chain, is found in Yang, Ramarimbahoaka and Elliott m. 


Lemma 2.5. Fori = 1,2, suppose (Y^A ^ is the solution of BSDE: 


yP = (,+ I U(s,YP,zf)ds- I {zPYdM,, ie[0,r]. 


Assume ^ 1,^2 ^ ond /i, /2 : x [0, T] x M x M satisfy some 

conditions such that the above two BSDEs have unigue solutions. More¬ 
over assume fi satisfies o and Assumption fS.fl If ■Ci ^ ^ 2 , o.s. and 
/i(t, < / 2 (t, a.e., a.s., then 


foranyte[0,T]) = l. 


42 ) 


2.3 RBSDEs with the Markov Chain Noise 

Ramarimbahoaka, Yang and Elliott [7] introduced a reflected BSDE (RB- 
SDE) for the Markov Chain and derived the existence and uniqueness of the 
solutions. This is an equation of the form: 

i) yt = C + f {s, Vs, Zs)ds + KT-Kt- Z'JMs, 0<t<r; 

h) Vt > Gt, 0 Y t < T; 

iii) {Kt,t G [0,T]} is continuous and increasing, moreover, Kq = 0 and 
J^iVs-Gs)dKs = 0. 

Lemma 2.6. Suppose we have: 

1 . e G L\Dt), 

2. aVx measurable function / :Dx[0,r]xMx —)■ M which 

is Lipschitz continuous, with constants d and c”, in the sense that, for 
any t G [0, T], Vi,V2 G M and Zi,Z2 G t G [0, T], 

\f{t,Vi,Zi) - f{t,V2,Z2)\ < c'\vi - V2\ + c"||zi - Z 2 \\xt (8) 
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and c" satisfies 


c"||^|||Arxiv\/6m < 1, for any tG[0,T], (9) 

where ^ is given in (jS]) and m > Q is the bound of HAIIa^xat? for any 
te [o,T]. 


3. 


E 


\f{t,Q,0)\dt 


uo 


< oo, 


( 10 ) 


f. a process G called an “obstacle” which satisfies 


E 


sup {Gff 

0<t<T 


< OO. 


( 11 ) 


Then there exists a solution {V,Z,K), V adapted and ROLL and Z pre¬ 
dictable, of the RBSDE i), ii), Hi) above such that V G L3r(0,T;M), Kj- G 
L‘^{Et) and Z G moreover, this solution is unique up to indis- 

tinguishability for Y, K and equality d{X, X)t xP-a.s. forZ. 


3 Estimate of the solutions to RBSDEs for 
the Markov Chain 

Proposition 3.1. Suppose ^ G f satisfies (jS]), ([2]), ffTI?]) and G 

satisfies ffTTl) . Let {y,Z,K) be the solution of the RBSDE for the Markov 
Chain satisfying: 

' Vt = ^ + f{s,V,,Z,)ds + KT-K,- Z'^dM,, 0<t<T; 

Gt, 0 Y t < T; 

< 

{Kt,t G [0,T]} is continuous and increasing, moreover, Kq = 0 and 

, J^{V,-G,)dK, = 0. 

Then there exists a constant G > 0 depending on the Lipschitz constants c', c" 
of f and T such that 

E[ sup + E[ r \\Zt\\%dt] + E[\Kt\^] 

0<t<T Jo 

<G{E[\^\‘^+ sup{Gff + {[ |/(s,0,0)|(is)2]. 

0<s<T Jo 
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Proof. Applying the product rule to we derive for any t G [0,T], 

m^ = \c\^-2 rvs-dVs- 

t<s<T 

= + 2 VJ{s, K, Z,)ds + 2 VsdK, 

- 2 f Vs-Z'JM, - Y, ^VsAVs, (12) 

t<s<T 

where 


5^ akak 

t<s<T 


J2 (z;aa',)(z;ax.) = Z'AXAX'.Z, 


t<s<T 

rT 


t<s<T 


Z'idLs + d{X,X))Z,= / Z'JLsZs + 


\Zs\\x/s. 


(13) 


As {Kt,t e [0,T]} is an increasing process, and moreover, for any t G [0,r], 
Vt > Gt, we know for any t G [0, T], 

{Vs-Gs)dKs< [ {Vs-Gs)dKs = 0. 

Jo 



So we have 


VsdKs = 


GgdKg, t G [0,T], 


(14) 


By (EJ, flT^ and f[T4|l . we obtain for any t G [0,T], 

= \(\^ + 2Yvj{s,V,,Z,)ds + 2l^G,dK, 


-2 Y Vs-Z'dM, - Y Z'JL^Z, - j; 


\Zs\\xds. 


Now, let /3 > 0 be an arbitrary constant and write c = max{c',c"}. Using 
Ito’s formula for we deduce for any t G [0,T], 

E[eJ^\Vt\^] + U[/f/3|U,|V^ds] + E[Y e^^WZsfxM 

= + 2E[Y eJ^Vsfis, K, Zs)ds] + 2U[/f eJ^GsdKf\ 

<U[e/'^|^P]+2U[/fe/'lU,|(|/(5,0,0)| + |/(s,K,Z,)-/(s,0,0)|)ds] 

+2e^^E[Y GsdKs] 


< + 2E|/,^e'5‘|V;|(|/(s,0,0)1 + c|KI + c||Z.|U.)o!sl 

+2e^'^Elji^GJK.] 

< B[e'”'|5|"] +2E|/,^e'=*|l^,| ■ |/(s,0,0)1*] + (2c + 3c")£|/f e'’'|V".P<is] 

+ 2el>^EiKT sup (GJ)] 

o 0<s<T 

< £'[e^^|^p] + 2E[ sup e^^^\Vs\ e^^‘^\f{s, 0, 0)\ds] 

sG[t,T] 

+(2c + 3^)El}^ el>‘\V,\^ds] + iB[/,^e»-||Z,||5,.*] 

2/3T 

+- E[ sup (G+)2] + aE[K^] 

a o<s<T 

< E[e^'^\^\‘^] + 'yE[ sup + —E[{J^ e5^^|/(s, 0, 0)|(is)^] 

s&[t,T] 7 

+(2c + 3c=)Bl/,^e'"H/,p*] + ef\\Z.\\\ds] 

2/3T 

+- E[ sup {Gtf] + aE[K^], 

OL 0<s<T 

where a ,7 > 0 are two arbitrary constants. Therefore, for any t G [0,T], 

E[ef^^\Vt\^] + (/3 - 2c - 3c2)i?[^^ e^^\\Zs\\j,Js] 

< E[e^^\^\^]+^E[ sup + -E[{ [ e>|/(s, 0, O)^^)^] 

se[t,r] 7 Jt 

2/3T 

+- E[ sup (G+)2] + aE[K^]. (15) 

« o<s<r 

We now give an estimate for E[K^]. Because Kt = Vq — ^ — f{t, Vt, Zt)dt 
+ Z'^dMt, by Lemma [2Tl we deduce 

E[\Kt\^]<4E[\Vo\^ + \C\^+\ r f{t,Vt,Z,)dt\^ + \ r Z',dM,\^] 

Jo Jo 

< 4i!;[|l/„p + + rilZiliy*] 

Jo 

+ 4B[( [ (|/(i,0,0)1 + cjVil + c||Z,|U.)*)"] 

Jo 
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< 4i5||V'„|= + |(;|= + r \\Z4%dt] + 12i5|( r |/((, 0,0)|*)"l 
Jo Jo 

+ 12c"B[(/ \Vt\dty] + 12rdEl(f ||Z,|U.rfi)"] 


= 4i5[|JP + IVil'^l + (4 + 12c^r)i5[ / ||Z,|li.*l 

Jo 

+ 12E[{ r \f{t, 0, 0)\dtf] + 12c^TE[ f \Vt\^dt]. 

Jo Jo 

So, there is a constant Ci > 0 depending on c and T such that 

E[\Kt\^] 

< c.(i!;||^p + ivii^ + ( r |/((,0,0)1*)" + TdVir + \\Zt\\l,)dt]) 

Jo Jo 

< C,(£;|e'”-|J|2 + |V),|2+ ( j e^^‘\f(t,0,0)\dtf] 


+ C,E[ e4‘(|m" + ||Z,|lt,)*l) 


(16) 


1 2 

Then we consider t = 0 in ffTHjl . Set a = —— and fJ = 2c + 3c^ + we 

3Ci 3 

obtain 

E[\V,\'‘]+E[r e^-{\v.\^ + \\z.\\\_)ds\ 

Jo 

< Ae^^E[\i\^] + 37h;[ sup + (- + 1)£^[( T e^^^|/(s, 0, 0)|ds)2] 

sG[0,T] 7 Jo 


+ 9Cie^^^E[ sup (G+)2]. 

0<s<T 

Then by ffTB]l and ffT7|l . we derive 


(17) 


Z[|A'tI" 1 < 5(7,64^J!K|"]+Cl)-+ 2)B[(/ e4»|/(«,0,0)1*)"] 

7 Jo 

+ 3Ci-fE[ sup + 9Cle^^^E[ sup (G+)2]. (18) 

se[0,T] 0<S<T 

Because Vt = ^ + f{s, Vg, Zs)ds + Kt — Kt — Z'gdMg, 0 < t < T, we 
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have for t G [0, T], 

E[snp 

0<t<T 

< Elm"] + \f(^,V„Z.)\dsy + 4 \Kt\^ + sup 4\ Z',dM.\^] 


0<t<T 


< £|4|5p + 12(C |/(s,0,0)1*)" + lOTc"/."’(IKI" + \\Z.\\\,)ds] 


+EH\Kt\^ + 4 sup \C Z',dM,\‘] 

0<t<T 

< h;[4e^^|e|2 + 12{J^ e- 2 ^V{s, 0, 0)\dsY + 12Tc^ 


+E[A\Kt\^ + 4 sup I Z'^dMsW 


0<t<T 


Using Doob’s inequality and Lemma [2.11 we know 


E[ sup I / 

0<t<T Jt 


Z'JMs]^] = E[ sup I / 
0 <t<T Jo 

rT 


Z'^dMs- / Z'^dMs\^] 


<2E[\ / Z'dM,|2+ sup I / Z'dM.p] 

Jo 0 <t<T Jo 

<10E\\! Z;<iM,|"| = 10B|/' ||Z,||i*| 


<10B[/ e»‘\\Z.\\'Us]. 


Hence, with the help of ffT 7 |l we conclude 
E[ sup |U| 2 ] 

0<t<T 

< 4(1 + 5Ui)e^^sU[|eP] + (12 + ^ + 8C'i)U[( f e^^V(s, 0, 0)dsf] 

7 Jo 

+ 12C'i 7U[ sup + 3 QCy^^E[ sup ( 6 '+)^] 

se[0,T] 0<S<T 

+ 12Tc^E[[ ef^^m^ + \\Z4\^^Jds]+A0E[[ 

Jo Jo 

< 4(1 + 5Ci)e^^U[|er] + (12 + ^ + 8Ui)U[( [ 0, Q)dsf] 

1 Jo 

+ 12C'i 7U[ sup e^^lU.n + E[ sup ( 6 '+)^] 

se[0,T] 0<S<T 

+ {l2Tc^ + A0)E[ [ + WZ^jcJds] 
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< 4(41 + SCi + l2Tc^)e^^E[\i\^] 

+ (52 + SCi + 12 Tc 2 + 12^1+ 36rc^ +120 ^^^^ e5^V(s, 0, 0)c/s)2] 

7 Jo 

+ 36Ci(C'i + 3 Tc2 + 10)e^^'^E[ sup (G'+) 2 ] 

0<s<T 

+ 12 (C'i + 3rc2 + 10 ) 7 £;[ sup ef^^\VsW 

sG[0,T] 

Noticing £^[sup,g[o,r] < e^^£;[sup,g[o,r] set 7 = 24 ( 0 ^ + sTc^ + 10)e/^^ 

we deduce there exists a constant (^2 > 0 depending on T and c such that 

E[ sup < C 2 {E[\^\‘^ + snp {GjY + { [ |/(s, 0, 0)|ds)2]. (19) 

0<t<T 0<s<T Jo 

By ffTTl) . ffTSj) and ffT^ we know there exists a constant C > 0 depending on 
T and c such that 

E[ sup + E[ f \\Zt\\\dt] + E[\Kt\^] 

0 <t<T Jo 

<C{E[\^\‘^+ sup{Gtf + {[ |/(s,0,0)|ds)2]. 

0<s<T Jo 

□ 

Similarly we obtain the following result for the solutions to BSDEs driven 
by the Markov Chain. 

Proposition 3.2. Suppose ^ G LS‘{Et) and f satisfies ([8]), flT0|) . Let {Y, Z) 
be the solution of the BSDE for the Markov Chain as following 

= e + ^ f{s,Y,,Z,)ds-Z'^dMs, 0<f<T. 

Then there exists a constant C" > 0 depending on the Lipschitz constants 
c',c" of f and T such that 

E[sup \Yt\^]+E[[ \\Zt\\%dt] < C\E[\f\^ + { [ \f{s,0,0)\dsf]. 

0 <t<T Jo Jo 
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4 Continuous dependence property of solu¬ 
tions to RBSDEs for the Markov Chain 


Proposition 4.1. Suppose f satisfies ([8]), ([9]), ffTOl) . ^ E satis¬ 
fies ca, and t E [0,T]} is a predictable process satisfying 

EiT \^f^\^dt]<oo, ( 20 ) 

Jo 

where i = 1,2. Let Z^'^\ iT^) be the solution of RBSDE for the Markov 
Chain as following 


^ =ii + fi^(f(s, zF) + ipi'^)ds + kP - Kf - {zf'^ydMs, t E [0, T] 

te[0,r]; 


E [0,r]} is continuous and increasing, moreover, Kff^ = 0 and 

I =0, 


(0 _ 


where i = 1, 2. Set (u, z) = ^(i) _ ^( 2 )^^ j. = ^( 1 ) _ ^( 2 )^ 

there exists a constant C > 0 depending on the Lipschitz constants c', c" of f 
and T such that 

sup E[\vty] + E[J^ \\zt\\xt(^t] + sup E[\kT - kt^] 
te[o,T] te[o,T] 

<C{E[\^i-^ 2 \^+ -ipf\dtf + sup 

te[o,r] 


Moreover, 


E[ sup \vt + ktl^] + /o 
te[o,r] 

<CE[\fi-- ^f\dtf + sup \G^P-Gf\\ 

te[o,r] 

Proof. Applying the product rule to |utp, we have: 

\vt\^ 

= l?i - ?2t + 2 fiv.Uis, vm.zP) - /(s. vP.zP) + (»,<'> - .f<p))ds 


Vgdks — 2 / Vs-z'gdMs 


ZgdLgZg 




( 21 ) 
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Since = 0, we have 

Vgdks 

= - VP')dKW - j\vy' - VP)dKf^ 

= j\vP - GW)<iA'i‘> - j\vm - G'-p)dKm 
- r(Vy>-G<P)dKP+ r(V}^>-G<P)dKP 


+ / Gi‘>dKi'> 




i Gf^dKi^^- 

= - (vf>-Gf>MAf'-^Vi‘’-G«MAf> + {G^^-Gf^)dk, 

< [(G^ - Gf>)dk.. (22) 

Write c = max{c', c"}. By (1^ and fl2^ . we obtain 
\\zs\\xM 

< E[\^, - + 2 i?[/f (G^ - 

+2i?[/f l^;,! • \f{s, vP,zi^^) - f{s, VP\ZP) + - y.f )|ds] 


<i?[|ei- 6 P]+ 2 i?[c/f KKK 
+2E[J^{G^^^ - G?^)dk,] 


+ ll^^sllxjds + - ip^^^\ds] 


^ -^[I'Ci ~ ^ 2 p] + E[J^ ((2c + 3c^ + l)|r’sp + 2 ll^sllx^ + — ‘f^^'^\‘^)ds] 

+2E[\kT-kt\- sup |Gi'^-G?^|] 

sG[t,T] 


^ E[\Ci ~ 'C 2 P] + E[J^ ((2c + 3c^ + l)|r’sp + 2 ll^sllxJ'^'S] 

+E[J^^ - (pi^^pds] + eE[ sup |Gi^^ - + -E[\kT - 

sG[i,T] e 

(23) 
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where e > 0 is an arbitrary positive constant. Since for any t G [0, T] 


o. = ?1 - 6 + ^ ((/(S, vm,zP) - /(S. ry. zf)) + (rf' - ))<is 

+ kT-kt - [ z'^dMs, te[0,T], 


by Doob’s ineqnality and Lemma [2. II we deduce 


E[\kT-h\^] 

<AE[\^,-C2\^ + \vt\^ + \j\idM,\^] 

+ AE[\ - fis, + ((pW - V’f^))ds\^] 

< 4:E[\^i — ^ 2 ]'^ + \vt\‘^ + Iksllx^ds] 

+ \fis, V}^\zi^^) - fis, V,^^\zP)\dsf + - ipf^dsf] 

< ^E[\^i — ^2\^ + \vt\^ + j^ Iksllx^ds] 

< ^E[\^i — ^2\^ + \vt\^ + j^ Iksllx^ds] 

+ 16c2Ti?[ f{\vs\^ + WzsWlJds] + 8E[{ f - ^f^\dsf] 

Jt Jt 

< 4Z|I6 - &n + 4Z[|i.y] + 8S|( L I*)"] 

+ lQc^TE[l \vs\^ds\+A{l + Ac^T)E[l \\z,\\j^ds]. (24) 

Jt Jt 

Set e = 8(l + 4c^r) in inequality ([23]). With the help of inequality fl24|l . from 
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inequality fl25]) we derive for any t E [ 0 , T], 

+ W^Alx^ds] 

< - ^r] + E[j^ (2c + 3c2 + 2)\vs\‘^ds] 

+ 2E[i r - ipf^ldsf] + 8(1 + Ac^T)E[ sup |G« - ]. (25) 

Jt sG[t,T] 

Using Gronwall’s inequality, by (12^ we have for any t E [0,T], 

E[W] 

< (3E[|6 - + 4(fo^ + 16(1 + 4c^T) sup - G?^\^]) 

sg[0,T] 

. g2(2c+3c2+2)(T-q 

So there exists a constant G 3 > 0 depending on the constants c and T such 
that 


sup EWvt^^] 
te[o,T] 

< C,E[\i, - 


61 




ipf\dtf + sup |gS^^ 
te[o,r] 



( 26 ) 


Noting E[J^ \vs\'^ds] < {T — t) sup £'[|z;tp] for t E [0,T], by fl25|l and 

iG[0,T] 

fl26|l we know there exists a constant G 4 > 0 depending on the constants c 
and T such that 

sup E[\vt\‘^] + E[J^ \\zt\\x^dt] + sup E[\kT-kt\'^] 

iG[0,r] tg[0,T] , , 

<G4U[|^i-^2p + (/o^|<^S^^-¥?fV^)^+ sup 

t€[0,T] 


Because 

V, + *1 = «i - & + fiUE Vi'Kz'E - no, + (vP - nP))ds 


+ kx — 



t ^ [ 0 , T], 
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we deduce 


E[ sup \vt + kt\^] 

tG[0,T] 

<4£;[|ei-6P] + 4£;[|fcTp]+4E[sup I [ 

te[o,r] Jt 

+ 4B1( r \(f(s, p'), Zi») - f(s. VP, Zfl)) + (rf) - P^')|<is)^|. 

Jo 

By dSlD, set t = 0, we derive 

E[\kT\^]< 4E[|,^i-^ 2 p]+4 sup +8£;[(/(f 

se[o,T] 

+ 16c^T£'[Jq^ |uspds] + 4(1 + 4:C^T)E[J^ 

Then by we obtain there exists a constant C 5 > 0 depending on the 
constants c and T such that 

E[ sup \vt +ktl"^] + \\zt\\x^dt] 

te[o,T] 

< + (/o \dty + sup G^p]. 

te[o,T] 


□ 

Similarly we obtain the following result for the solutions to BSDEs driven 
by the Markov Chain. 

Proposition 4.2. Suppose f satisfies (IHl),(IinD, fi e L‘^{Et), and t G 

[0,T]} is a predictable process satisfying / f^) . Let ^/^g solution 

of the BSDE for the Markov Chain as following 

yL =(. + jff(a, n'*’, Zf) + ‘fiOds - j\zf)'dM„ t € [ 0 , T], 

where i = 1,2. Set {y,z) = (yB) _ y(2)^2'B) — Then there exists a 

constant C > 0 depending on the Lipschitz constant c of f and T such that 

E[ sup \yt\^] + < C'E[\fi - + {Jq - T^^ldtf]- 

te[o,r] 
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5 A Comparison theorem for one-dimensional 
RBSDEs driven by the Markov chain 

Suppose (Y, Z, K) and {V, U, J) are the solutions of the following two 
RBSDEs for the Markov Chain, respectively, 

' yt = ii + f{s,Y,,Z,)ds + KT-K,- J^Z'JM,, 0<t<T; 

Gt, 0<t<T; 

< 

{Kt,t G [0,T]} is continuous and increasing, moreover, Kq = 0 and 

. f^{Ys-G,)dK, = 0, 

and 

^ Rt = 6 + 9{s,Vs,Us)ds + JT-Jt- li^U'dMs, 0<t<T-, 

R > Gt, 0 < f < T; 

< 

{Jt,t G [0,T]} is continuous and increasing, moreover, Jq = 0 and 
, J^{Vs-Gs)dJs = 0, 

Theorem 5.1. Assume ^ 1,^2 ^ G satisfies flTT]) . and f,g satisfy 

dH]), dH]) and flTU]) . If < ^ 2 , a.s., and f{t,v,z) < g{t,v,z), a.e., a.s., for 
any t G [0, T], (n, z) G M x then 

P{Yt < R, for any t G [0,T]) = 1 


and 

P{Kt > R, for any t G [0,T]) = 1. 

Proof. For each n G N, (t, v, z) G [0, T] x M x , dehne: 

fn{t, n, z) = /(f, V, z) + n{v - Gt)~. 

It is clear that /„ is Lipschitz continuous. For each n G N, consider BSDE 

y” = 6 + / /«(s.n“. z")ds- j\z’;)'dM„ o<t<T. 

By Lemma 12.31 for each n G N, the above equation has a unique solution 
{Y^,Z^) G L^(0,r;M) x Pj-(0, T; R'^). For each n G N, dehne: 

AT” = n [ {Yfi - Gs)~ds. 

Jo 


18 






On the other hand, for each n G N, {t, v, z) G [0, T] x M x , define: 
gn{t, V, z) = g{t, V, z) + n{v - Gt)~. 

It is clear that gn is Lipschitz continnous. For each n G M, consider BSDE 

vr = + f 9n{s, v;, U^)ds - j\u^ydM,, 0<t<T. 

By Lemma 12.31 for each n G M, the above eqnation has a nniqne solntion 
(I/", f/") G L'jr{0,T;R) x For each n G N, define: 

jy = n[ {vy - Gs)~ds. 

Jo 

For each n G N, /„ satisfies Assumption 12.41 and /„ < gn- Therefore from 
Lemma 12.51 for each n G N, 

P{YJ^ < Vt, for any t G [0, T]) = 1. 

That is, for any n G N, there exists a subset Bn ^ ^ such that P{Bn) = 1 

_ OO 

and for any u G i?„, Yy'iuj) < Vy{u), for any t G [0,T]. Let i? = Bn, 

n=l 

hence P{B) = 1 and for each u e B, Yy^{u) < Vy'{uj), for any t G [0,r], 
n G N. Hence 


P(sup r” < sup for any t G [0, T]) = 1. 

nSN nCN 

From the proof of existence in Ramarimbahoaka, Yang and Elliott [7] we 
have Yt = sup Yy- and Vt = sup t G [0, T]. Thus, 

nGN nGN 

P{Yt < Vt, for any t G [0, T]) = 1. 


Also from the proof of existence in Ramarimbahoaka, Yang and Elliott [7j 
we have when n ^ oo. 


£■[ sup \Ky — Kt\‘^] ^ 0 and 

0<t<T 


E[ sup \jy - Jt\^] 0. 

0<t<T 


Then for any e > 0, 


lim P( sup \Ky — Kt\ > e) = 0 and 

n->oo o<i<T 


lim P{ sup 

n^oo o<t<T 


jn 


Jt\ > e) — 0. 
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So there exists a subsequence {n^; k E N} G {n; n G N} and a subsequence 
{nkm'i m G N} C {uk, /c G N} such that 

lim sup \K^'^ — Kt\ =0, a.e. 

k^oo o<t<T 

and 

lim sup IJ”*’™ — Ji| =0, a.e. 

m^oo o<t<T 

Therefore, 

P( lim = Kf, for any t G [0, T]) = 1; 

m—>-oo 

and P{ lim = Jt, for any t G [0,T]) = 1. 


That is, there is a subset A C such that P{A) = 1 and for any oj E A, 

lim = Kt{u) and lim for any t E [0,T]. 

m—>-oo m—>-oo 

Now we prove for any u E B, (w) > (ca), for any t E [0, T], m G N. 

Noticing on B, , for any t E [0, T], m G N, there are three cases: 

1. If E [0,T] X B such that Gt{uj) < for any 

m eN, then 

— Gt)~{uj) = — Gt)~{uj) = 0, for any m G N. 

By the dehnition of and 7”*=™ we deduce 

for any m G N. 

2. If E [0,T] X B such that < Gtiy) < for any 

m G N, then 

_ Q^Yiy) > 0 = — G'i)“(a;), for any m G N. 

Then we derive (ca) > for any m G N. 

3. If {t,u) E [0,T] X B such that Yy'^iy) < Vy'^iy) < Gt{uj), for any 
m eN, then 

{Yy^-G^nu) = Gt{u)-Yy-{u:) > Gt{uj)-vy-{u) = -Gt)-{u), 

for any m G N. Then we obtain Ky^{u) > jy^{uj), for any m G N. 
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Hence we know for any u e B, (u) > J”*"™ (w), for any f G [0, T], m G N. 
Thus, for any u ^ B, 

lim > lini for any t G [0,T]. 

m—)-oo m^oo 

Therefore, for any a; G H fl 5, 

Ktiu) = lim K^'"^{uj) > lim = Jt{oo), for any t G [0,T]. 

m—>-oo m—>-oo 

Because P{A O B) = 1, we conclude 

P{Kt > Jt, for any t G [0,T]) = 1. 


□ 


6 Conclusion 

In this paper, we have provided an estimate for the solutions of RBSDEs, 
derived a continuous dependence property for their solutions with respect to 
the parameters of the equations, and established a comparison result for the 
solutions of RBSDEs driven by a Markov chain. 
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